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14.  Abatraat 


This  document  presents  the  Terminal  Doppler  Weather  Radar  (TDWR) ,  Build  5 
enhancement.  Test  and  Evaluation  Master  Plan  <TEMP) .  This  Build  5  TEMP  identifies 
Operational  Test  and  Evaluation  (OT&E)  objectives,  responsibilities,  resources, 
schedules,  and  critical  test  issues.  The  Build  5  enhancement  consists  of  a  Build 
5A  which  provides  connectivity  to  the  Low  Level  Wind  Shear  Alert  System  (LLWAS)  II, 
and  a  Build  5B  which  provides  connectivity  to  an  LLWAS  III.  Build  5A  displays 
LLWAS  II  wind  data  along  with  TDWR  hazardous  weather  data  on  TDWR  Geographic 
Sitiiation  Displays  (GSD)  and  Ribbon  Display  Terminals  (RDT) .  Build  5B  provides 
additional  capabilities  such  as  having  a  Microburst  Shear  Integration  Algorithm 
(MSIA) ,  TDWR/LLWAS  III  Integration  Algorithm,  15-day  archiving  and  TDWR,  LLWAS  II 
and  LLWAS  III  data  integration. 
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EXECUTIVE  SUMMARY 


This  document  presents  the  Terminal  Doppler  Weather  Radar  (TDWR) ,  Build  5 
enhancement.  Test  and  Evaluation  Master  Plan  (TEMP).  This  Build  5  TEMP  identifies 
Operational  Test  and  Evaluation  (OT&E)  objectives,  responsibilities,  resources, 
schedules,  and  critical  test  issues.  The  Build  5  enhancement  consists  of  a 
Build  5A  which  provides  connectivity  to  the  Low  Level  Wind  Shear  Alert  System 
(LLWAS)  11,  and  a  Build  5B  which  provides  connectivity  to  an  LLWAS  111.  Build  5A 
displays  LLWAS  II  wind  data  along  with  TDWR  hazardous  weather  data  on  TDWR 
Geographic  Situation  Displays  (GSD)  and  Ribbon  Display  Terminals  (RDT) .  Build  5B 
provides  additional  capabilities  such  as  having  a  Microburst  Shear  Integration 
Algorithm  (MSIA) ,  TDWR/LLWAS  III  Integration  Algorithm,  15 -day  archiving:  and, 
integration  of  LLWAS  II,  TDWR  and  LLWAS  III  data. 

Build  5A  OT&E  is  planned  to  start  at  Memphis,  TN,  during  January  1994.  Build  SB 
OT&E  is  planned  during  the  September  to  November  1994,  timeframe  at  Denver,  CO, 
which  will  be  the  first  installed  site.  The  majority  of  the  weather  testing  will 
be  conducted  at  Orlando,  FL,  during  April  1995.  Desired  weather  phenomena 
typically  does  not  occur  in  the  fall  at  either  Denver  or  Orlando. 

A  test  risk  exists  regarding  the  LLWAS  prime  development  contractor's  ability  to 
complete  the  LLWAS  III  to  TDWR  interface  software  to  support  the  test  schedule 
provided  at  appendix  A. 


This  Test  and  Evaluation  Master  Plan  (TEMP)  provides  test  direction  for  the 
implementation  and  acceptance  of  the  Terminal  Doppler  Weather  Radar  (TDVR)  Build  5 
enhancement.  The  TDWR  Build  5  enhancement  integrates  Low  Level  Wind  Shear  Alert 
System  (LLWAS)  II  and  LLWAS  III  data  with  TDWR  data. 

Throughout  the  document  the  term  LLWAS  III  is  used.  Within  the  LLWAS  community, 
LLWAS  III  is  called  the  LLWAS  Network  Expansion  (NE)  system. 

The  development  contractor  will  develop  a  Contractor's  Master  Test  Plan  (CMTP) 
Build  5  Addendum  which  will  execute  the  development  contractor's  test 
responsibilities . 

This  Build  5  TEMP  follows  the  FAA-STD-024a  format  and  includes  FAA  Order  1810. 4B 
policy  requirements. 


The  purpose  of  this  TEMP  is  to  ensure  comprehensive  testing  is  conducted  through 
the  identification  of  organizational  responsibilities,  presentation  of  test 
methodology,  and  identification  of  test  requirements.  The  Operational  Test  and 
Evaluation  (OT&E)  must  ensure  that  Build  5A  and  Build  5B  effectively  interface  to 
LLWAS  systems  without  degrading  the  existing  baselined  system. 


This  TEMP  provides  for  the  comprehensive  testing  of  the  Build  5  enhancement  to 
ensure  it  satisfies  user  and  National  Airspace  System  (NAS)  requirements.  It 
describes  the  Test  and  Evaluation  (T&E)  processes  for  ensuring  this  enhancement 
project  meets  applicable  project  specification  (FAA-E-2806/1)  and  system/subsystem 
requirements  allocated  in  NAS-SS-IOOO,  Volumes  I,  III,  and  V.  Federal  Aviation 
Administration  (FAA)  organizational  responsibilities,  requirements,  and  test 
methodologies  are  provided.  A  Verification  Requirements  Traceability  Matrix  (VRTM) 
which  Integrates  physical,  functional,  operational  effectiveness,  and  NAS 
operational  suitability  requirements  is  included  at  appendix  B. 


The  following  specifications,  standards,  and  other  documents  were  used  in  the 
developswnt  of  this  TEMP. 


2.1  FAA  DOCUMENTS. 


2..1.1  FAA  Specifications. 


NAS -SS- 100 


NAS -SS- 1000 

NAS -SS- 1000 


FAA- E- 2806/1 


NAS  System  Specification,  Volume  I,  Functional  and  Performance 
Requirements  for  the  National  Airspace  System  General, 

October  1992. 

NAS  System  Specification,  Volvime  III,  Functional  and  Performance 
Requirements  for  the  Ground- to-Alr  Element,  February  1993. 

NAS  System  Specification,  Volume  V,  Functional  and  Performance 
Requirements  for  the  National  Airspace  System  Maintenance  and 
Operations  Support  Element,  October  1992. 

Specification  Terminal  Doppler  Weather  Radar,  November  12,  1992, 
w/SCN  1,  January  2,  1993. 


2tl.2 _ FAA  Standards. 


,FAA-STD-024a  Preparation  of  Test  and  Evaluation  Plans  and  Test  Procedures, 

August  17,  1987. 

2.1.? _ Other  FAA  Publications. 


NAS-MD-790 

NAS-MD-793 

FAA  ORDER 
1810. 4B 


Interface  Control  Document  (ICD) ,  Maintenance  Processor 
Subsystems  (MPS)  to  Remote  Monitoring  Subsystems  (RMSs)  and 
Remote  Monitoring  Sxibsystem  Concentrators  (RMSCs) ,  June  10,  1986. 

Remote  Maintenance  Monitoring  System  Functional  Requirements  for 
the  Remote  Monitoring  Subsystem  (RMS),  Febnxary  28,  1986. 

FAA  NAS  Test  and  Evaluation  Policy,  October  22,  1992. 


NAS -MD- 110  Test  and  Evaluation  (T&E)  Terms  and  Definitions  for  the  National 

Air  Space  System,  March  27,  1987 

OT&E  Test  Report  Final  Report  for  the  Air  Traffic  Control  Evaluation  of  the 

Prototype  Terminal  Doppler  Weather  Radar  System,  MCO,  Orlando, 
Florida,  September  1992. 

OT&E  Quick  Look  Terminal  Doppler  Weather  Radar,  Operation  Test  and  Evaluation 

(OT&E)  Integration  and  OT6£  Operational  Tests/Retests,  Quick  Look 
Report,  September  21,  1993. 


OT&E  Quick  Look  Terminal  Doppler  Weather  Radar  (TDWR)  Operational  Test  and 
Evaluation  Integration  and  Operational  Quick  Look  Report, 
November  12.  1992. 


OT&E  Quick  Look  Look  Terminal  Doppler  Weather  Radar  (TDWR)  RMS/MPS 

OT&E/Integratlon  Regression  Test  Quick  Look  Results,  dated 
June  30,  1993. 


Shakedown  Report  Evaluation  Report  Shakedown  Evaluation  Report,  January  19,  1993. 

Shakedown  Quick  Terminal  Doppler  Weather  Radar  (TDWR)  Shakedown  Regression  Test 
Look  Report  (Julck  Look  Report,  May  13,  1993. 


2.2  OTHER  STANDARDS. 


ANSI  X3.41-  American  National  Standard  Code  for  Information  Interchange. 

1974 


ANSI  X3.4-  American  National  Standard  Code  for  Information  Interchange . 

1977 


EIA-RS-232C 


ANSI  X3.64- 
1979 

ANSI  X3.66- 
1979 


EIA-530 


Interface  between  Data  Terminal  Equipment  and  Data  Communications 
Equipment  and  Data  Communications  Equipment  Employing  Serial 
Binary  Data  Interchange,  August  1969. 

Additional  Controls  for  Use  with  ASCII. 


American  National  Standard  for  Advanced  Data  Comoiunlcations 
Control  Procedures  (ADCCP) ,  January  1979 . 

Hl^  Speed  25 'Position  Interface  Data  Terminal  Equipment  and  Data 
Circuits,  April  1986. 


2.3  MILITARY  STANDARDS. 

MIL-STD-470B  Maintainability  Program  Requirements  (for  System  and  Equipments) , 

May  30,  1989. 

2.4  DEVELOPMENT  CONTRACTOR'S  DOCUMENTATION. 


D001-BLD5'2 

B022-Bld5-1A 


B022-Bld5-2B 

B022-Bld5'3B 


Contractor's  Master  Test  Plan  (CMTP)  Build  5  Addendum, 

January  12,  1993. 

Build  5  Software  Requirements  Specification  Radar  Product 
Generation  (RPG)  Software,  (CSCI-2)  CGG551591,  Revision  A, 
November  19 ,  1992 . 

Build  5  Software  Requirements  Specification  Remote  Monitoring 
Subsystem  CSCI-3,  CGG551592,  Revision  B,  Jvine  30,  1993. 

Build  5  Software  Requirements  Specification  Display  Computer 
Software,  CSCI-4,  CGG551594,  Revision  B,  Jtine  24,  1993. 
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3.1  OVERVIEW. 

Th«  IDHR  is  s  C'band  pencil  beam  doppler  radar  with  a  narrow  beam  width  (0.5*), 
high  sensitivity,  which  is  optimized  for  detection  of  hazardous  weather  in  the 
airport  terminal  area. 

The  system  has  two  operational  modes  and  one  maintenance  mode.  The  operational 
modes  consist  of  a  monitor  mode  and  a  hazardous  weather  mode.  In  the  monitor  mode, 
the  TDWR  performs  360*  scans  which  minimize  pedestal  wear.  The  TDUR  enters  the 
hazardous  weather  mode  and  performs  sector  scans  over  the  airport  terminal  area 
«dien  predefined  weather  conditions  are  detected.  The  maintenance  mode  is  manually 
selected  to  modify  operational  parameters,  perform  diagnostics,  and  perform  routine 
maintenance . 

The  TDWR  system  is  composed  of  four  functional  areas;  Radar  Data  Acquisition  (RDA) , 
Radar  Product  Generation  (RFG) ,  Remote  Monitoring  Subsystem  (RMS) ,  and  Display 
Functioital  Unit  (DFU) .  The  RDA  performs  weather  detection,  clutter  handling,  and 
primitive  processing.  The  RPG  performs  weather  product  generation,  RDA  scan 
control,  external  user  output  generation,  and  archiving.  Archived  data  will 
consist  of  TDWR/LXUAS  II  and/or  TDWR/LLWAS  III,  Geographic  Situation  Display 
(GSD)/Ribbon  Display  Terminal  (RDT)  blanking,  and  programmable  alarm  timeouts.  The 
RMS  performs  system  monitoring,  fault  isolation,  and  alarm  reporting.  The  DFU 
provides  interim  display  and  control. 

The  TDWR  will  interface  to  LLWAS  II  system  (Build  5A) ,  LLWAS  III  system  (Build  5B) , 
or  both  systems  simultaneously.  Build  5A  displays  LLWAS  II  wind  data  along  with 
TDWR  hazardous  weather  data  on  the  TDWR  GSD  and  RDT.  The  LLWAS  II  system  consists 
of  six  anemometers,  a  computer,  and  alphanumeric  displays  for  reporting  airport 
winds  and  Wind  Shear  alarms.  Build  5B  accomplishes  the  following: 

a.  Interfaces  the  TDWR  RPG  and  GSD  to  the  LLWAS  II  and/or  III  systems, 

b.  Integrates  TDWR  and  LLWAS  III  Wind  Shear  alarms, 

c.  Enhances  TDWR  microburst  product  alarm  generation, 

d.  Provides  for  15  days  of  archive  data  at  the  GSD, 

e.  Performs  RDT  and  GSD  blanking, 

f.  Provides  RDT  and  GSD  audible  alarm  timeouts. 

The  TDWR  and  LLWAS  III  Wind  Shear  alarm  Integration  is  accomplished  using 
Government  Furnished  Information  (GFI)  TDWR/LLWAS  III  algorithm.  Microburst  alarms 
are  enhanced  with  a  GFI  Hicroburst  Shear  Integration  Algorithm  (MSIA) . 

The  LLWAS  III  system  consists  of  10  to  29  anemometers,  a  computer,  and  uses  the 
TDWRs,  RDTs,  and  GSDs  to  display  alphanumeric  wind  and  Wind  Shear  data. 

A  failure  of  either  the  DFU/LLWAS  link  or  TDWR  will  result  in  a  string  of 
9s  displayed  for  all  LLWAS  centerfleld  winds  and  a  blanking  of  threshold  winds. 

This  same  scenario  occurs  if  the  RFG  to  LLWAS  and  DFU  to  LLWAS  links  fail.  A 
string  of  9s  are  displayed  for  individual  LLWAS  sensor  failures. 
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The  TDWR  mission  Is  to  provide  the  timely  detection  and  reporting  of  hazardous  Wind 
Shear  phenomena  in  and  near  the  terminal  approach  and  departure  zones  of  an 
airport.  A  secondary  function  is  to  predict  wind  shifts  and  detection  of  other 
hazardous  weather. 

At  airports  where  the  TDWR  will  be  located  with  an  LLWAS  111,  Build  5B  will  combine 
the  two  systems  into  a  single  Wind  Shear  detection  system.  An  algorithm  takes 
alphanumeric  runway  alert  messages  generated  by  each  subsyste.:>  and  Joins  them  into 
integrated  alert  messages.  The  MSIA  and  TDWR/LLWAS  III  alert  integration 
algorithms  accomplishes  two  important  functions: 

a.  Maintains  the  probability  of  detection  for  hazardous  events  while 
reducing  the  number  of  false  alerts  and  microburst  oveirwarnings , 

b.  Increases  the  accuracy  of  loss/gain  Wind  Shear  estimates. 

At  airports  where  the  TDWR  will  be  located  with  a  LLWAS  II,  the  LLWAS  II  will 
provide  the  TDWR  with  Center  Field  Winds  (CFW)  and  sector  winds  (no  Wind  Shear 
information) . 

Until  the  Tower  Computer  Control  Complex  (TCCC)  becomes  available,  Integrated  TDWR 
and  LLWAS  data  will  be  presented  on  TDWR  alphanumeric  and  graphic  displays . 


Message  processing  and  product  display  is  dependent  on  the  operational  status  of 
the  respective  Interfaced  TDWR  and  LLWAS  system(s).  The  following  identifies  data 
source  and  message  output  which  will  be  of  concern  to  test  personnel: 

a.  TDWR  Alphanumeric  Microburst  Alarm  Messages  are  generated  from  TDWR 
weather  data  once  per  minute  (minimum) .  This  is  an  update  rate  required  by 
NAS ‘SS- 1000,  Volume  I,  paragraph  3. 2. 1.2. 5. 2. 9,  which  states,  "The  TDWR  shall 
provide  weather  data  to  specialists  that  is  no  older  than  1  minute . " 

b.  LLWAS  III  Alphanumeric  Microburst  Alarm  Messages  are  generated  by  the 
LLWAS  III  and  transmitted  to  the  TDWR. 

c.  Integrated  Alphanumeric  Microburst  Alarm  Messages  are  generated  each  time 
LLWAS  III  data  is  received. 

d.  Threshold  winds  (runway  arrival  and  departure  end  winds)  are  generated 
by  the  LLWAS  III  and  transmitted  to  the  TDWR.  The  LLWAS  II  provides  wind  data 
detected  by  each  of  its  sensors  to  the  TDWR  which  can  be  mapped  to  airport  rvmways 
and  then  displayed  as  threshold  winds  for  that  rxinway. 

e.  CFW  information  is  generated  by  either  the  LLWAS  II  or  LLWAS  III  and  is 
then  transmitted  to  the  TDWR. 

f.  TDWR  Alphanumeric  Gust  Front  Alarm  Messages  are  generated  from  TDWR 
weather  data. 


g.  LLUAS  III  Alphanunerlc  Gust  Front  Alarm  Messages  are  generated  by  the 
LIMAS  III  and  transmitted  to  the  TDUR. 

h.  Integrated  Alphanumeric  Gust  Front  Alarm  Messages  are  generated  each  time 
LLVAS  III  data  is  received. 

i.  Graphic  Microburst  Products  are  generated  only  from  TDWR  data.  Area 
Noted  for  Attention  (ARENAS)  will  be  highlighted  in  the  event  of  an  LLWAS-only 
detected  microburst. 


j.  Graphic  Gust  Front  Products  are  generated  only  from  TDWR  data.  ARENAS 
will  be  highlighted  in  the  event  of  an  LLWAS-only  detected  gust  front. 

3.4_.EUILD  5  FUNCTIONALITY. 


The  following  provides  an  understanding  of  Build  5  functions  and  their  respective 
responsibility; 


a.  RPG  Build  5A  function  provides  the  following: 

1.  LLWAS  II  Data  Transfer, 

2.  LLWAS  II  Threshold  and  CFW  processing, 

3.  LLWAS  II  message  element  formatting. 


b.  RPG  Build  5B  function  provides  the  following: 


1.  LLWAS  III  Data  Transfer, 

2.  LLWAS  III  Threshold  and  CFW  processing, 

3.  LLWAS  II  message  element  formatting, 

4.  TDWR/LLWAS  III  Integration  Algorithm  processing, 

5.  Integrated  Mlcroburst/Gust  Front  alarm  condition  detection, 

6.  Alarm  graphic/alphanumeric  message  formatting, 

7.  Non-MSIA  losses  and  MSIA  rotinding, 

8.  Message  forwarding  to  the  TCCC. 


c.  RMS  Build  5A  and  Build  5B  functions  provide  the  following: 

1.  Performance  Monitoring  capability, 

2.  Maintenance  Data  Terminal  (MDT)  screens  and  menus  display  changes, 

3.  Adaptation  data  changes. 
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The  Build  5A  RMS  function  also  provides  for  definition  changes  to  the  ARENA.  An 
ARENA  identifies  geographical  location(s) ,  on  or  near  an  airport,  where  winds  could 
affect  users.  Wind  Shear  events  are  reported  on  DFUs  if  the  events  meet  criteria 
and  occur  within  these  areas.  Note:  Events  are  shown  on  the  GSD  regardless  of 
whether  they  occur  within  ARENAS. 

d.  SUN-IFX  Build  5  function  does  the  following: 

1.  Displays  weather  products  and  alert  messages, 

2.  Interfaces  with  the  RFG, 

3.  Interfaces  with  both  LLVAS  II  and  LLWAS  III, 

4 .  Displays  ARENAS , 

5.  Displays  from  DFU  selected  ninways, 

6.  Displays  Build  5B  integrated  weather  alert  messages, 

7.  Allows  setting  of  programmable  alarm  timeouts, 

8.  Provides  backup  interface  with  LLWAS  II  and/or  III, 

9.  Provides  15 -day  archive  capability. 

NOTE:  SUN-IPX  is  a  SUN  workstation  model. 

e.  Display  Build  5A  function  does  the  following: 

1.  Provides  format  for  threshold  winds, 

2.  Provides  display  for  LLWAS  II  data, 

3.  Provides  LLWAS  II  link  backup. 

f.  Display  Build  5B  function  does  the  following: 

1.  Displays  integrated  weather  alert  messages, 

2.  Displays  LLWAS  III  data;  e.g.,  CFW,  threshold  winds,  alarm  messages, 

3.  Displays  LLWAS  II  data, 

4.  Provides  LLWAS  II  and  LLWAS  III  link(s)  backup, 

5.  Provides  15 -day  archive, 

6.  Provides  programmable  alarm  timeouts. 
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5  SYSTEtt  IHTimCES. 

NAS -SS- 1000  specification  identified  TOUR  Build  5  interfaces  are  described  in  this 
section. 

3.5.1  TDWR-LLWAS  II  (Six  Sensor^. 

A  1200-baud  (Bd)  communications  interface  will  exist  between  the  TDWR  and  the 
LUNAS  II.  Figure  3. 5. 1-1  presents  the  TDVR/UMAS  II  interface. 


LLWASPoMef 


FIGURE  3. 5. 1-1.  TDWR/LLWAS  II  INTERFACE  DEPICTION 
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A  9600>Bd  coannmicatlons  Interface  will  exist  between  the  TDUR  and  the  LLVAS  III 
Figure  3.S.2-1  presents  the  TDUR/LLUAS  III  Interface. 


U.WAS  Point  o( 


FIGURE  3. 5. 2-1.  TDWR/LUIAS  III  INTERFACE  DEPICTION 
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The  TDWR  interfaces  with  the  RNMS  for  the  transmission  of  maintenance  data  and  the 
receipt  of  commands  and  messages.  The  RMMS  will  remotely  control  and  monitor  the 
maintenance  status  of  the  TDUR.  KHMS  subsystems  and  their  respective  interface 
test  requirements  include: 

a.  Maintenance  Processor  Subsystem  (MPS):  Link  layer  OT&E  will  ensure  the 
MPS  to  RMS  link  level  activity  is  in  accordance  with  NAS -MD* 790,  June  1986;  and 
application  layer  testing  will  ensure  the  MPS  can  send  commands  and  monitor 
equipment  status  as  required. 

b .  Maintenance  Data  Terminal  (MDT) :  OT&E  will  verify  the  MDT  port  is 
RS-232,  asynchronous,  self  adj\xs table  to  1200,  2400,  4800,  or  9600  Bd,  and 
ASCII  8-blt  code  compliant  per  ANSI  X3.4  and  ANSI  X3.41.  Application  layer 
testing  will  show  compliance  with  the  requirements  of  FAA>E'2806/1,  NAS-MD>793, 
and  NAS-SS*1000  Volume  I,  appendix  III. 

Figure  3. 5. 3-1  presents  the  TDUR  to  MPS  and  MDT  interfaces. 


FIGURE  3. 5. 3-1.  TDUR/MPS  AND  MDT  INTERFACE  DEPICTION 
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3.5.4  Tovar  Control  CoinmtftlL  CQBPltX  (TCC£). 

The  TDWR  interface  will  provide  for  the  transmission  of  products,  equipment  statiis, 
TDHR  modes,  and  receipt  of  commands.  Comminications  between  the  TDWR  and  the  TCCC 
will  be  9600  bits  per  second  (bps),  point-to-point,  two-way,  simultaneous,  and 
nonswitched.  The  physical  interface  shall  conform  to  ANSI  X3. 66-1979  protocol. 

The  TCCC  will  provide  data  to  appropriate  air  traffic  control  (ATC)  facilities  when 
it  becMMS  available.  Figure  3. 5. 4-1  presents  the  TDWR  and  TCCC  interface. 


TPWW  Point  Pt  DanimwiMon 


FIGURE  3. 5. 4-1.  TDWRACCC  INTERFACE  DEPICTION 
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The  Build  5  enhancement  Is  to  improve  reliability  of  Wind  Shear  and  microburst 
reporting  by  combining  the  capabilities  of  the  TDVR  and  UNAS  systems.  The  TOWR, 
for  Build  5A,  will  accept  LLWAS  II  center  field  and  sensor  winds  for  display  on  the 
GSD  and  RDT.  For  Build  SB  configurations,  the  TDWR  will  accept  Wind  Shear  and 
microburst  alarms  for  integration  with  the  TDVR  produced  alarms,  along  with 
centerfield  and  runway  threshold  winds.  Build  5  consists  of  hardware  and  software 
changes  to  integrate  UNAS  II  and  III  data  with  TDWR. 

1^6.  REQUIRED  OPERATIONAL  CHARACTERISTICS. 

The  Build  5  enhancement  will  have  the  following  capabilities: 

a.  Interface  with  and  accurately  display  IXWAS  II  and  III  data/status, 

b.  Perform  the  government- furnished  U.VAS  integration  algorithm, 

c.  Reduce  overwamings  due  to  MSIA  processing, 

d.  Meet  Microburst  Probability  of  Detection  (POD)  design  goal  of  90  percent 
(for  microbursts  within  6  nautical  miles  (nmi)  of  the  Airport  Reference  Point) , 

e.  Meet  microburst  false  alarm  ratio  (FAR)  design  goal  of  10  percent  (for 
microbtirsts  within  6  nmi  of  the  Airport  Reference  Point) , 

f.  Transfer  UNAS  CFW  products  to  the  RPG  within  15  seconds  per 
FAA-E-2806/1,  table  IV, 

g.  Generate  and  distribute  microburst  or  gust  front  alarm  within  25  seconds 
from  collection  of  data, 

h.  Distribute  gust  front,  UNAS  Winds,  UNAS  Threshold  Winds,  UNAS  CFW 
products  to  displays  and  ports  within  15  seconds  and  precipitation  products  within 
60  seconds, 

i.  Provide  15 -day  archiving  capability. 

3.7  REQUIRED  TECHNICAL  CHARACTERISTICS. 

The  following  are  key  technical  characteristics,  performance  goals,  and  thresholds 
which  must  be  met.  OT&E  will  ensure: 

a.  Gust  Front  Integrated  UNAS  alarm  product  is  provided  the  RPG  within 
5  seconds;  (Specification  FAA-E-2806/1  requirement  is  15  seconds) 

b.  CFWs  are  displayed  within  5  seconds  at  the  SUN-IPX;  (Specification 
FAA-E-2806/1  requirement  is  15  seconds) 

c.  Link  layer  communications  provide  reliable  data  transmission; 
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d.  Digitized  wlndspeed,  direction,  end  gust  data  are  provided  to  the  air 
traffic  control  tover  (ATCT)  once  every  10  seconds; 

e.  Wind  Shear  alert  information  is  transmitted  to  the  ATCT  within  10  seconds 
of  detection; 

f.  LLUAS  and  TDWR  equipment  contains  built-in  capabilities  for  monitoring 
and  control  of  equipment;  e.g.,  RMS  provides  equipment  failure  alarms, 
certification  data,  and  diagnostic  testing; 

g.  System  reliability  meets  a  Mean  Time  Between  Failure  (MTBF)  of  550  hours. 
The  Mean  Time  Between  Critical  Failures  (MTBCF)  meet  or  exceed  1500  hours; 

h.  The  SUK-IPX  work  station  does  not  diminish  basedlined  system  performance. 
3.8  CRITICAL  TEST  AND  EVAUJATION  ISSUES. 

XlLJL _ Technical  Issues. 

The  following  describes  technological  or  engineering  risks  that  might  either  impact 
testing  or  must  be  addressed  by  testing: 

a.  Build  5  test  accosq>lishment  per  the  TEMP  schedule  depends  on  the 
LLUAS  III  prime  development  contractor  completing  the  LLUAS  III  to  TOUR  interface 
software . 

b.  Historical  TDUR  data  indicates  that  required  system  reliability  and 
availability  have  been  unsatisfactory.  Build  5  OT&E  will  need  to  ensure  that 
contractor  implemented  "fixes"  have  been  effective. 

c.  Previous  test  reports  have  commented  on  questionable  test  integrity  due 
to  software  "fixes."  OT&E  test  personnel  will  need  to  minimize  this  risk  at  the 
start  of  test  by  not  conducting  testing  if  assurances  cannot  be  provided  that  the 
software  is  baselined. 

d.  The  TDUR  during  initial  testing  failed  to  meet  POD  design  goals  for 
microbtjxsts .  The  test  team  will  need  to  be  careful  in  their  conclusions  regarding 
Build  5  iiq>act  on  system  performance. 

3.8.2  Operational  Issues. 

The  following  describes  key  operational  effectiveness  or  suitability  issues  which 
must  be  addressed  during  testing.  OT&E  test  teams  will  have  responsibility  for: 

a.  Ensuring  reliable  operation  from  both  software  and  hardware  in  delivering 
required  weather  products, 

b.  Ensuring  no  degradation  in  the  timely  receipt  of  weather  products  using 
the  Build  5  enhancement, 

c.  Ensiirlng  RMS  maintenance  data  is  processed  and  transmitted  in  accordance 
with  applicable  directives. 
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d.  Ensuring  the  Build  5  can  process  Information  from  both  an  LLWAS  II  and 
LItfAS  III  system  simultaneously, 

e.  Ensuring  the  operational  effectiveness  of  the  MSIA  (will  be  difficult  to 
assess  unless  Wind  Shear  or  microburst  weather  is  available  during  the  test 
period) , 

f.  Ensuring  the  ROT  and  GSD  screens  are  blanked  and  an  equipment  status 
message  is  displayed  on  the  ROT  when  any  of  the  following  conditions  occur; 

1.  ROT  communication  is  interrupted  longer  than  an  adaptable  time  period 
(with  a  default  value  equal  to  approximately  1  minute) , 

2.  The  TOUR  and  LLUAS  is  nonoperatlonal  due  to  a  failure, 

3.  The  GSD  fails. 

The  ROT  screen  shall  again  present  data  when  the  blanking  condltion(s)  no  longer 
exists.  These  blanking  conditions  are  specified  per  FAA-E-2806/1. 

g.  Ensuring  the  ROT  is  readable  in  full  sunlight.  The  ROT  shall  be 
readable : 


1.  fr<Mi  a  distance  of  10  feet  and  at  angles  of  60*  from  center  line 
for  the  Standard  Ribbon  Display; 

,  2.  from  a  distance  of  6  feet  and  at  angles  of  •+  60*  from  center  line 

for  small  Envelope  Ribbon  Display.  No  hood  shall  be  used. 

h.  Ensuring  the  TDUR  accurately  archives  15  days  of  derived  products. 

In  summary,  the  TDHR  must  be  thoroughly  evaluated  in  its  capability  to  suitably 
provide  LLUAS  wind  information,  centerfields  and  runway  threshold  winds,  along  with 
TDUR  weather  products  on  the  GSD  and  RDT.  If  the  two  LLUAS  systems  and  TDUR  are 
sited  at  the  same  location,  testing  must  demonstrate  that  the  TDUR  functions 
satisfactorily . 


4.  PROGRAM  SUMMARY. 


kA 


(ORGANIZATIONAL  AND  FUNCTIONAL  RESPONSIBILITIES) . 


4.1.1  Orsanization  Primary  Roles  and  Functions. 

ANR-SOO  The  Program  Manager  (m)  directs  and  manages  all  FAA  activities  for 

TDUR  and  Build  5  development  and  implementation.  The  PM  is  responsible 
for  the  sttpervislon,  design,  development,  integrated  logistics  support, 
evaluation,  and  MAS  implementation.  The  PM  is  the  program  spokesperson 
Inside  and  outside  the  FAA,  Including  Congress,  other  government 
agencies,  contractors,  the  aviation  community,  and  the  media.  The  PM 
is  responsible  for  receiving  Test  Policy  Review  Committee  (TPRC) 
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approval;  distributing  the  TEMP;  approving  OT&E  Integration  and 
Operational  test  requirenents ,  plans,  and  reports;  presenting  test 
deployment  issues  to  Deployment  Readiness  Review  (DRR) ;  and  preparing 
test  NAS  Change  Proposals  (NCPs)  for  designated  test  locations. 


ANR*900  The  Associate  Program  Manager  for  Engineering  (APHE)  directs,  manages, 
and  accomplishes  engineering  activities  delineated  in  program 
directives.  The  APME  appro^'es  program  directives  Jointly  with  the  FAA 
Technical  Center;  approves  test  budgets  and  appoints  the  Project 
Manager.  The  Project  Manager  provides  assistance  and  support  to  the 
isqplementation  of  this  TEMP  through  the  review  of  related  test  plans, 
procedures,  test  data  and  test  reports.  The  APME  in  conjunction  with 
the  ACV-200D  Associate  Program  Manager  for  Test  (APMT)  presents  reviews 
to  the  TPRC  as  required. 

ANS-430  The  Associate  Program  Manager  for  Logistics  (APML)  directs,  manages, 
and  accomplishes  logistics  and  training  activities  delineated  in 
program  directives. 

ACV-200D  The  AnfT  is  the  focal  point  for  testing;  acts  as  the  agent  of  the  PM  to 
manage  the  T&E  Program;  establishes  overall  test  schedules;  coordinates 
tests;  ensxires  that  all  test  requirements  are  satisfied;  and  ensures 
tests  are  performed  in  accordance  with  approved  procedures.  The  APMT 
ensures  preparation  of  FAA  TEMP,  OT&E  Integration  and  OT&E  Operational 
Test  Plan  and  Procedures  are  in  accordance  with  FAA-STD>024a  and  FAA 
Order  1810.48;  is  responsible  for  all  aspects  of  OT&E  Integration  and 
OT&E  Operational  testing;  writes  test  reports;  witnesses  factory/ 
development  testing;  conducts  Test  Schedule  Status  Review  (TSSR) 
meetings;  provides  recommendations  based  on  test  results  in  support  of 
the  IffiR  Executive  Committee  (EXC(M)  process;  and  coordinates  required 
system  downtime  with  sector  Airway  Facility  (AF)  personnel. 

ANA- 200/  The  Maintenance  Automation  ARIE  provides,  if  required,  MPS  simulator, 
700  RMS  simulator,  and  Interface  Control  Document  Database  Development  Tool 
(ICDDT)  software.  ANA- 200/700  will  Install  the  Interim  Monitor  Control 
Software  (IMCS)  decoder  module  and  conduct  confidence  testing. 

AOS -200  AOS -200  is  responsible  for  the  development  and  preparation  of  the 

Build  5  OT&E  Shakedown  plan,  procedures  and  reports.  AOS  identifies 
and  develops  with  the  PH  and  APMT,  OT&E  Shakedown  requirements  for 
inclusion  in  the  FAA  TEMP;  approves  OT&E  Shakedown  plans,  procedures 
and  reports;  and  conducts  0T8£  Shakedown.  AOS  reviews  technical 
instruction  books  for  completeness  and  technical  accuracy;  approves  in 
coordination  with  Air  Traffic  Plans  &  Requirements  Service  (ATR) 
additional  OT&E  Shakedown  requirements  that  do  not  exceed  OT&E 
Shakedown  durations  or  costs  as  baselined  in  the  TEMP.  ATR  will 
support  and  participate  in  those  tests  that  are  applicable  to  ATR  OT&E 
Shakedown  requirements.  AOS  provides  a  deployment  recommendation  based 
on  OT&E  Shakedown  results  to  the  DRR. 

AOS-530  AOS-530  performs  key  site  deployment  testing  of  IMCS  software. 
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ACN-IOOD 

ASE-600 

ATQ 

NSSL 

Contractor 

Support 

Prime 

Developer 

Regions 

TPRC 

ATR-120 


ASU 


ACN-IOOD  conducts  OT&E  RNMS  testing  in  accordance  with  approved  plans 
and  procedures. 

ASE  Engineering  Specialties  and  Configuration  Management  Division 
(ASE-600)  serves  as  TPRC  Secretariat;  formulates  revisions  to  test 
policy,  test  standards,  and  definitions  for  consideration  and 
endorsement  by  the  TPRC.  ASE  verifies  compliance  with  FAA  Order 
1810. 4B  and  standards  such  as  FAA-STD-024a.  ASE  provides  and  maintains 
implementation  traceability  for  NAS  Verification  via  the  VRTMs 
contained  In  the  NAS -SS- 1000  System  Specifications. 

ATQ  is  a  mendier  of  TPRC;  responsible  for  progrtun  oversl^t;  co-approves 
TEMPs;  reviews  and  comments  on  T&E  requirements,  plans,  procedures,  and 
reports.  ATQ,  the  Office  of  Independent  Operational  Testing  and 
Evaluation  (lOT&E)  Oversight  will  monitor  Che  Build  5  enhancement  to 
TDHR  program. 

National  Severe  Storms  Lab  (NSSL)  provides  meteorological  support,  test 
data,  and  test  reports  to  ACW-200D. 

Support  contractors  provide  assistance  In  the  accomplishment  of  T&E 
activities;  e.g. ,  planning,  conducting,  and  reporting. 

The  prime  develoi»ent  contractor  develops  and  performs  testing 
according  to  government  direction.  The  prisie  development  contractor 
provides  test  support,  as  requested,  and  resolves  deficiencies  related 
Co  testing. 

Region  personnel  support  activities  which  lead  to  site  acceptance  and 
field  shakedown. 

The  TPRC  is  responsible  for  approving  TEMPs;  providing  Information 
Indirectly  to  the  EXCOH  for  the  final  deployment  decision;  approves 
test  policy  waivers;  and  resolves  disagreements  on  T&E  Issues  when 
agreements  cannot  be  reached  at  lower  levels  of  FAA  management. 

ATR  provides  TEMP  requirements;  reviews  the  FAA  TEMP;  provides 
operational  expertise  and  planning  for  conducting  and  analyzing  test 
data;  reviews  PAT&E  requirements;  provides  personnel  to  support 
monitoring  and  conduct  of  PAT&E;  supports  test  plan  development; 
reviews  OT&E  Integration  and  OT&E  Operational  test  plans  and  procedures 
for  tests;  determines  the  operational  acceptability  of  new  ATC 
operational  computer  programs  or  systems  prior  to  their  delivery  for 
operational  testing  and  use  In  field  facilities;  monitors  the  conduct 
of  Field  Shakedown;  reviews  Field  Shakedown  reports;  provides  a 
deployment  recoimaendatlon  based  on  OT&E  Shakedown  results  to  the  DRR; 
and  is  a  member  of  the  TPRC. 

The  Office  of  Acquisition  Support  (ASU)  Is  a  member  of  TPRC;  reviews 
FAA  TEMP,  contractor's  TEMP,  Production  Acceptance  Test  and  Evalxiatlon 
(PAT&E)  test  plans,  procedures  and  reports;  and  verifies  completeness 
of  program  testing  by  reviewing  final  OT&E  reports. 
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Regional 

AF 


Regional  AF  personnel  are  responsible  for  overall  Field  Shakedown  in 
cooperation  with  the  Air  Traffic  Division. 


Division  Sector  personnel  provide  maintenance  support  for  OT&E  activities  and  Is 
AF  Sectors  responsible  for  coordinating  schedule  outages  with  Air  Traffic  (AT) . 


Regional  AT  provides  coordination  to  Airway  Facilities  Division  for  Field 

AT  Shakedown  requirements,  plans,  procedures  and  reports;  participates  in 

Division  conduct  of  OT&E  as  coordinated  with  the  ATR  organization. 


AT  AT  participates  in  FAA  TEMP  activities  as  requested  by  ATR  through 

Facilities  Regional  Air  Traffic  Division;  supports  development  of  Field  Shakedown 
requirements  plans,  procedures,  and  reports  in  coordination  with  AF 
organizations . 

4.2  INTEGRATED  SCHEDULE. 


Higl\  level  planning  anticipates  Build  5A  will  be  completed  during  November  1993; 
and  the  Build  5B  software  will  be  delivered  to  the  FAA  during  August  1994.  The 
following  variables  have  the  potential  for  disrupting  this  schedule; 

a.  Funding  could  limit  the  scope  of  testing  and  severely  impact  the  duration 
of  testing. 

b.  A  lack  of  Wind  Shear  and  microburst  weather  during  the  scheduled  fall 
test  periods  will  likely  impact  quality  of  weather  testing.  Continuation  of 
weather  testing  will  be  conducted  at  Orlando,  FL,  during  April  1995.  The  Orlando 
site  during  the  spring  offers  considerable  weather  phenomena.  Test  oversight 
personnel  have  raised  the  concern  about  not  having  strong  convective  weather 
phenomena  during  testing  for  valid  operational  assessments. 


c.  The  schedule  does  not  address  the  TCCC/TDUR  interface  due  to  the 
unavailability  of  the  TCCC.  Once  developed,  the  Advanced  Automation  System  (AAS) 
Program  Office  will  have  the  responsibility  for  verifying  and  conforming  to  this 
interface . 


d.  TDWR/RHS  IMCS  is  expected  to  be  available  to  provide  for  RMS  testing 
during  Build  5B.  The  TEMP  test  schedule  has  provided  for  RMS  testing  at  Denver 
during  the  Build  5B  test. 

e.  ANA- 700  will  need  to  receive  the  TDWR  RMS/MPS  ICD  containing  the  new  data 
points  for  review  and  evaluation  in  a  timely  manner  to  ensure  the  IMCS  software  is 
available  for  testing  as  proposed. 

Reference  appendix  A  for  the  TEMP  OT&E  schedule.  This  schedule  evolved  out  of  the 
TSSR,  Septeniber  22,  1993,  which  was  held  at  the  FAA  Technical  Center.  The  schedule 
appears  to  be  reasonable  at  this  time. 
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The  Mjor  test  docvunents  to  be  developed  for  the  Build  5  effort,  and  the 
responsible  organizations,  are  listed  in  table  4.3-1.  Separate  test  plans  and 
procedures  will  be  written  for  the  Build  SA  and  Build  SB  due  to  potential  funding 
shortfalls.  FUnds  nay  not  be  available  to  write  all  plans  and  do  all  testing. 


TABLE  4.3-1.  TEST  PLAN/PROCEDURES  LISTING 


DOCOMENT  TITLE 

RESPONSIBLE  (»tGANIZATI0N 

FAA  TEMP 

ACtf-200D 

Contractor's  Hast  Test  Plan  <CMTP) 

OevelopBent  Contractor 

Software  Test  Plan 

Developaent  Contractor 

Turnkey  Installation  Test  Plan 

Developaent  Contractor 

Systen  Test  Procedures 

Developaent  Contractor 

Final  Initial  Checkout  ««wt  Acceptance 
<1C6A)  Test  Procedures 

Developaent  Contractor 

Test  Reports  (Systes/Software) 

Developaent  Contractor 

Contractor's  Test  Procedures 

Developaent  Contractor 

T^  FAA  OT&E  (^rational  and  Integration 
Test  Plana  (Build  SA  &  Build  SB) 

ACW-200D 

Two  FAA  OT&E  Operational  and  Integration 
Test  Procedures  (Build  SA  &  Build  SB) 

ACU-200D 

RNS  OT&B  Test  Plan/Procedures 

ACN-IOOD 

Two  OT&E  Shakedown  Plans 

Build  SA  &  Build  SB 

AOS -200 

Two  OT&E  Shakedown  Procedures 
Build  SA  &  Build  SB 


AOS -200 


This  tssC  plan  follows  FAA*STD-024a  and  Includes  FAA  Order  1810. 4B  philosophy 
and  organizational  Information.  The  TEMP  identifies  verification  methods  for 
contractor,  integration,  operational,  and  shakedown.  The  TEMF’s  purpose  is  to 
define  the  overall  approach  for  conducting  the  Build  5  test  program. 

_ DaYaloPnant  Test  and  Evaluation  Plan. 

Build  5  does  not  require  a  DT&E  plan. 

4. 3.2.1  Reliability  Plan. 

The  development  contractor  Is  not  required  to  develop  a  separate  Reliability  Plan 
for  the  Build  5  enhancement.  Reliability  reporting  will  continue  as  presently 
established  \mder  the  TDWR  program. 

_ Maintainability  Plan. 

The  development  contractor  is  not  required  to  develop  a  separate  maintainability 
Plan  for  the  Build  5  enhancement. 

_ Electromagnetic  Interference . 

The  Build  5  enhancement  will  not  require  Electromagnetic  Compatibility  (EMC)  or 
Electromagnetic  Interference  (EMI)  testing. 


4.3.3_  Operational  Test  &  Evaluation  (OT&E)  Plans. 

The  FAA  conducts  OT&E  to  evalxiate  the  subsystem  operational  effectiveness  and 
suitability  including  Interoperability,  degraded  operations,  maintainability  and 
svtpportabillty .  OT&E  also  identifies  deficiencies  In  NAS  hardware,  software  human 
performance  factors  and/or  operational  concepts.  0T6iE  consists  of  three  test 
phases:  Integration,  Operational,  and  Shakedown.  Each  of  these  phases  is 
addressed  in  the  TEMP.  Division  of  responsibilities  for  FAA  OT&E  (Integration, 
Operation,  Shakedown)  are  illustrated  in  figure  4. 3. 3-1.  Since  Build  5  is  an 
enhancement  to  the  basic  TDUR  only  those  areas  not  shadowed  will  be  evaluated.  The 
OT&E  Integration  and  OT&E  Operational  Test  Flan  will  be  combined  into  one  plan  for 
separate  Build  5A  and  Build  5B  plans.  Separate  test  plans  will  be  written  for 
Build  SA  and  Build  5B  OT&E  Shakedown. 


FAA  OT&E  Integration/OperationaiyShakedown 

Test  Philosophy 


FIGURE  4. 3. 3-1.  DEPICTION  OF  OT&E  TEST  RESPONSIBILITIES 
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The  AHCT  has  responsibility  for  developing  the  OT&E  Integration  and  OT&E 
Operational  Test  Plan  in  accordance  with  FAA>STD-024a.  OT&E  Integration  consists 
of  testing  N&S  system  end>to-end  performance  which  is  addressed  in  NAS-SS-1000, 
Volume  I  (system  level)  and  Volumes  III  and  V  (subsystem  level) .  This  testing 
establishes  NAS  baseline  performance  (end-to>end)  and  verifies  that  previously 
existing  NAS  performance  has  not  been  degraded.  To  the  greatest  extent  possible, 
subsystem  testing  will  be  tested  in  a  NAS  equivalent  environment.  The  tests 
addressed  in  this  plan  shall  be  of  a  quantitative  and  qualitative  nature  and  are 
deemed  successful  if  the  results  meet  FAA-E-2806/1  and  NAS-SS-1000  qualification 
requirements.  Included  are  test  criteria  which  OT&E  personnel  will  use  to  verify 
the  operation  of  multiple  interfaces  and  Integration  with  other  systems  in  the 
operational  environment.  Requirements  not  practical  for  testing  by  the  prime 
development  contractor,  such  as  Interface  with  IMCS  software  and  human  factors, 
shall  be  included. 

OT&E  Operational  issues  reflect  system/subsystem  response  and  performance 
requirements  for  those  areas  Indicated  in  figure  4. 3. 3-1. 


AOS -200  will  develop  this  test  plan  in  accordance  with  FAA- STD -024a.  Shakedown  is 
an  Independent  verification  and  validation  to  verify  operational  effectiveness, 
suitability,  supportabillty,  and  maintainability  of  the  Build  5  enhancement. 


The  prime  development  contractor  shall  develop  and  execute  an  addendum  to  the  CMTP. 
This  plan  will  prove  through  test,  demonstration,  Inspection,  and  analysis  that  the 
Build  5  requirements  described  in  specifications  FAA- E- 2806,  System/Segment  Design 
Document  (S/SDD) ,  and  Engineering  Report,  ER/300-87-08-001  are  satisfied.  Since 
Build  5  is  an  enhancement  to  the  initial  TDUR  procurement,  the  plan  will  not 
address  the  following: 

a.  Algorithm  Implementation  Test/Demonstration, 

b.  Clutter  Suppression  Demonstration, 

c.  EMI  and  EMC  Radio  Frequency  Interference  (RFI)  Tests, 

d.  Environmental/type  tests, 

e.  Federal  Communications  Commission  (FCC)  Type  acceptance, 

f.  Hardware  tests, 

g.  Human  engineering, 

h.  Maintainability  demonstration, 

i.  National  Telecommunication  and  Information  Administration  (NTIA)  Spectrum, 

j .  PAT&E  Procedure  Validation, 

k.  Pulse  Repetition  Frequency  (FRF)  Selection  Demonstration, 

l.  Reliability  Demonstration, 

m.  Signal  Processing  Simulation, 

n.  System  alignment. 


Build  5A  interface  testing  will  verify  that  the  TDWR  Interfaces  with  the  LLWAS  II 
for  receipt  of  LLWAS  status,  wind,  and  configuration  data.  A  government  supplied 
NFS  simulator  will  be  used  to  emulate  RMMS  functions.  A  PC  LLWAS  simulator  must  be 
available  for  LLWAS  II  and  LLWAS  III  Integration  testing  with  the  TDWR. 

iJLi _ Prime  Development  Contractor  DT&E  Plan. 

No  Development  Test  and  Evaluation  (DT&E)  Flan  Is  required  for  Build  5.  However, 
In-Plant  System-Level  testing  will  be  Included  in  the  CMTP.  An  Interface, 
test  will  be  accomplished  to  qualify  new  system-level  LLWAS  II  and  LLWAS  III 
requirements  utilizing  LLWAS  simulators.  A  system  demonstration  will  be  performed 
to  validate  end-user  system  operation  and  will  utilize  baseline  certified 
procedures  from  Contract  Data  Requirements  Lists  (CDRLs)  DOlO-lla  (RMS 
Demonstration)  and  D010-23a  (Weather  Demonstration)  to  assess  functional  compliance 
of  the  TDWR. 

— Prime  Development  Contractor  PAT&E  Plan. 

Build  5  Is  a  software  Intensive  effort  and  will  not  require  a  PAT&E  Plan.  FAT&E 
for  this  software  will  consist  of  an  inspection  of  the  end  product  and  associated 
documentation  to  verify  It  Is  identical  to  the  software  baseline. 

_ Prime  Development  Contractor  IC&A  Plan. 

Final  Initial  Checkout  and  Acceptance  (IC&A)  Test  Procedures  will  be  developed. 

The  primary  objective  of  IC&A  is  to  verify  satisfactory  operation  of  the  software 
at  each  Installed  site. 


DT&E/PAT&E  OUTLINE. 


5.1  DT&E/PAT&E  TO  DATE. 

The  DT&E  for  the  TDWR  primary  system  has  been  completed.  PAT££  has  been  completed 
on  some  production  systems. 

5.2  FUTURE  DT&E/PAT&E. 

The  DT&E  will  be  performed  according  to  CDRLs  for  Build  5.  The  most  illustrative 
of  future  contractor  testing  involves  a  System  Enhancement  Test  to  ensure: 

a.  Requirements  specified  in  the  government  directed  enhancement  have  been 
correctly  Implemented. 

b.  The  Build  5  enhancement  has  not  adversely  affected  other  system 
functions  and  parameters.  Testing  should  consist  of  certification  checks, 
on-line  diagnostics,  weather  algorithms,  performance  monitoring,  GSD,  RDT,  and 
operational  entries. 

c.  Testing  shall  be  run  utilizing  a  full  load  weather  scenario  consisting  of 
five  microbursts  and  six  gust  fronts  as  a  minimum.  During  this  test  any  valid 
operational  command  shall  be  permitted  and  system  timing  and  capacity  shall  be 
verified. 
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5.3  DT&6/?AT4B.SMEgTIVES. 

The  DT&E  will  be  performed  to  ensure  the  developed  system  complies  with  the 
software  requirements  specification  and  the  Statement  of  Work  (SOU) .  PAT6£ 
objectives  are  normally  developed  to  ensure  product  quality  Is  retained  for  all 
systems  during  manufacturing  and  Implementation.  However,  no  PAT&E  objectives  are 
applicable  to  Build  5  enhancement. 

5.4  DT&E/PAT&E  SCOPE.  EVENTS.  SCENARIOS. 

The  DT&E  will  be  performed  per  CDRLs  to  ensure  Build  5  compliance  with  applicable 
specifications.  Host  significant  of  the  DT&E  effort  will  be  a  24-hour  test  which 
will  fully  stress  the  software  to  the  maximum  extent  possible  within  the  factory 
environment . 

5.5  CRITICAL  DT&E/PAT&E  ITEMS. 

No  critical  DT&E/PAT&E  items  have  been  Identified  relative  to  Build  5  enhancement. 


6.  OT&E  INTEGRATION  TESTING. 


Test  procedures  will  be  developed  to  ensure  compliance  with  NAS -SS- 1000,  Volximes  I, 
III,  and  V  requirements,  and  any  additional  requirements  needed  to  ensure 
successful  integration  of  the  system  Into  the  NAS. 

6.1  OT&E  INTEGRATION  TESTING  TO  DATE. 

The  following  reports  provide  the  status  of  OT&E  Integration  to  date:  Terminal 
Doppler  Ueather  Radar  (TDUR)  Operational  Test  and  Evaluation  Integration  and 
Operational  Quick  Look  Report,  November  12,  1992,  and  Teirmlnal  Doppler  Weather 
Radar,  Operation  Test  and  Evaluation  (OT&E)  Integration  and  OT&E  Operational 
Tests/Rests,  Quick  Look  Report,  Septe]id}er  21,  1993. 

The  following  reflects  on  initial  TDUR  RMS  OT&E  Integration  testing  conducted 
at  Oklahoma  City,  OK,  October  13  through  October  30,  1992,  and  retesting  at 
Hoxiston,  TX,  May  3  through  13,  1993. 

MPS  integration  testing  was  conducted  using  Interim  Monitor  and  Control  Software 
(IMCS),  version  PCC0711,  LM-1  protocol  analyzer  and  the  ACD'350  Enhanced  MPS 
Simulator,  version  1.01.  Logical  Unit  data  point  reporting,  erroneous  alam 
responses,  and  incorrect  MDT  data  were  major  deficiencies.  Testing  Identified 
32  critical  failures  related  to  the  RMS.  Retesting  In  Houston  solved  25  of  the 
original  37  problems,  however,  34  new  problems  were  Identified.  The  retest  Quick 
Look  Report  recommended  the  TDUR  not  be  deployed  until  all  22  critical  and  major 
problems  associated  with  the  RMS/MPS  are  corrected. 
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ACV-200D  will  develop  and  perform  functional  and  integration  tests  on  the  Build  5 
System  Etdtancement .  OT&E  testing  will  be  accomplished  in  two  phases: 

a.  Build  5A,  and 

b.  Build  5B. 


Build  SB  testing  will  evaluate  the  LLUAS  III  interface,  microburst  shear 
integration  algorithm,  GSD,  RDT,  audible  alarm  timeout,  ribbon  display  blanking, 
and  15-day  archiving. 

The  TDVR  RMS  will  require  testing  upon  baseline  of  the  TDWR  RMS/MPS  ICD,  and 
correction  of  previously  identified  failures.  ACN-IOOD  will  conduct  RMS  OT&E 
Integration  testing  to  ensure  any  RMS  operational  suitability  has  not  been  degraded 
because  of  Build  5.  New  data  points  have  been  added  for  the  Build  5  modification 
which  will  require  testing  in  accordance  with  NAS  specification  requirements 
presented  in  appendix  B. 

6^1  OT&E  INTEGRATION  TEST  OBJECTIVES. 

This  testing  is  to  ensure  the  successful  integration  of  NAS  sxibsystems  and 
NAS  systems.  The  TDUR  must  be  operationally  integrated  with  the  LXNAS  II  and 
LLUAS  III  systems.  The  TDUR  RMS  Interface  snist  show  compliance  to  NAS -MD- 790  and 
HAS -SS- 1000,  Volume  V  requirements.  The  archiving  function  must  meet  with  user 
satisfaction.  Ueather  processing  must  be  timely  and  result  in  reliable  products 
for  the  ATC  community.  The  ultimate  goal  of  integration  testing  is  to  ensure  NAS 
end-to-end  performance  is  suitable  to  the  user  community. 


6.4  OT&E  INTEGRATION  TEST  SCOPE. 


SCENARIOS. 


NAS  integration  requirements  are  derived  from  the  NAS  System  Specification. 

ACH-200D  will  determine  the  methodolo^  for  testing  these  interfaces,  either 
through  actual  connection  or  simulation.  An  independent  exercise  of  each 
interface  will  occur  to  validate  that  the  TDUR  performs  correctly  with  the  Build  5 
interfaces.  Build  5A  resting  at  Memphis,  TN,  will  ensure  this  combination  of  TDUR 
and  LLUAS  II  satisfactorily  interfaces  to  provide  useable  products  to  the  ATC.  The 
Memphis  site  offers  the  highest  possibility  of  correlating  TDUR  and  LLUAS  II  data. 
The  Denver  site  should  provide  the  maximum  stressing  of  the  software  due  to  the 
large  amount  of  data  produced  by  the  LLUAS  III.  The  TCCC  interface  will  be  tested 
vhen  it  becomes  available.  Each  message  Instead  of  consisting  of  7  to  12  sensors 
will  consist  of  29  sensors.  Test  scope  will  verify  the  integration  requirements 
presented  at  appendix  B.  Specific  events  and  scenarios  will  be  detailed  in  the 
OT&E  Integration  Test  Plan  and  subsequently  test  procedures.  The  Memphis  site  will 
demonstrate  correlation  of  TDUR  and  LLUAS  II  data.  The  Denver  site  will  result  in 
stressing  of  the  software  since  the  Denver  site  will  have  the  largest  amount  of 
site  adaptation  data  which  must  be  accommodated  and  the  greatest  amount  of  data  for 
the  processors  to  integrate. 
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6 >5  CRITICAL  OT&E  INTEGRATION  TEST  ITEMS. 

a.  Developing  techniques  which  adeqiiately  evaluate  the  full  operational 
configuration  and  degraded  performance  no^s  will  require  test  creativity.  In  the 
fully  operational  configuration,  data  from  both  the  TDVR  and  LLUAS  is  integrated  in 
the  RPG  and  the  resulting  alarm  messages  and  wind  data  are  displayed.  Since  the 
TDUR  is  required  to  provide  coverage  for  two  airports,  the  test  scenario  will  need 
to  ensure  the  TDUR  can  ingest  data  from  two  different  LXUAS  systems.  The  Build  SB 
is  required  to  process  LLVAS  II  and  III  data  simultaneously.  An  LLUAS  II  simulator 
will  be  required  for  this  test  since  only  the  LLUAS  III  is  installed  at  Denver. 

b.  A  secondary  critical  test  item  will  be  to  evaluate  the  proper  LLUAS 
operation  when  the  TDUR  is  in  either  a  failed  or  maintenance  mode.  System 
operation  differs  for  LLUAS  II  and  III  in  these  configurations.  For  instance: 

1.  The  DFU  shall  provide  for  LLUAS  II,  a  capability  to  map  LLUAS  sensor 
winds  to  specific  runways  for  presentation  as  threshold  wind  information.  This 
information  shall  be  routed  to  specific  ribbon  displays  according  to  the  runway 
configuration  table.  The  CFU  also  are  displayed. 

2.  LLUAS  III  alerts  and  threshold  wind  data  are  presented  directly  to 
the  GSD  and  RDT  displays. 

3.  Testing  will  need  to  establish  that  the  DFU  software  sets  the  switch 
to  LLUAS  to  Indicate  whether  the  TDUR  goes  into  the  maintenance  or  failed  mode.  In 
this  configuration,  a  red  X  should  appear  on  the  situation  display.  The  software 
will  need  to  be  evaliiated  to  determine  whether  the  switch  is  reset  when  the  TDUR 
res\imes  normal  operation. 

c.  A  test  risk  exists  regarding  the  LLUAS  prime  development  contractor's 
ability  to  complete  the  LLUAS  III  to  TDUR  Interface  software  within  the  test 
schedule  provided  at  appendix  A. 

d.  A  baselined  ICD  is  necessary  to  the  completion  of  IMCS  software. 


7.  OT&E  OPERATIONAL  TESTING. 


7.1  QT&E  OPERATIONAL  TESTING  TO  DATE. 

TDUR  OT&E  Integration  and  OT&E  Operational  tests  were  performed  in  Oklahoma  City, 
OK,  in  August  to  October  1992.  TDUR  OT&E  Integration  and  OT&E  Operational  tests 
and  retests  were  performed  in  Oklahoma  City,  OK;  Houston,  TX;  and  Memphis,  TN,  in 
March  to  September  1993.  The  following  OT&E  Operational  test/retests  were 
performed:  Ueather  Detection  Performance,  Reliability,  Availability, 
Grounding/Lightning  Protection,  Solar  Track  Measurement,  Air  Traffic  Control 
Suitability  Evaluation,  Security,  and  Vibration  Analysis. 
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Tasting  conducted  st  Oklahoma  City  concluded  that  the  TDWR  required  correction  of 
system  reconfiguration,  power  Interruption,  RMMS,  and  dociuaentatlon.  High  Gust 
Front  false  alarm  rates  and  lack  of  weather  products  In  attenuated  areas  were 
considered  deficiencies.  Concern  was  expressed  that  procedures  needed  to  be  In 
place  to  optimize  weather  detection  parameters  prior  to  future  Installations. 

Preliminary  OT&E  Operational  Heather  Retesting  data  analysis  Indicated  the 
following: 

a.  Microburst  POD  of  95  percent  (design  goal  -  90  percent  for  microbursts 
within  6  nml  of  the  Airport  Reference  Point) ; 

b.  Microburst  FAR  of  18  percent  (design  goal  -  10  percent  for  microbursts 
within  6  isbI  of  the  Airport  Reference  Point) ; 

c.  Gust  front  POD  of  66  percent  (gust  fronts  within  33  nml  of  the  TDWR); 

d.  Gust  front  FAR  of  24  percent  (gust  fronts  within  33  nml  of  the  TDUR) . 

Gust  front  and  microburst  FAR  and  gust  front  POD  were  unacceptable. 

System  reliability  had  a  MTBF  of  28  hours  (specification  requirement  Is  550  hours). 
The  Mean  Time  Between  Critical  Failures  (KTBCF)  was  112  hours,  whereas  the 
specification  requirement  Is  1500  hours.  The  system  also  failed  to  recover  after 
1>  second  power  lntern)q>tlons . 

The  ATC  evaluation  resulted  In  the  evaluators  rating  the  TDWR  with  a  89  percent 
favorable  response.  However,  two  critical  operational  Issues  were  Identified: 

a.  A  red  X  was  displayed  on  the  tower  and  TRACON  GSD  several  times  for 
unknown  reason(s) ; 

b.  A  gust  front  crossed  all  active  runways  hlghll^tlng  the  ARENAS  but  did 
not  alarm  the  ribbon  display  terminal  (RDT). 

Three  software  builds  were  used  during  this  test  period  which  catised  test  Integrity 
concerns.  Additional  follow-on  testing  will  be  required. 

The  TDUR  requires  system  reconfiguration.,  power  Interruption  recovery,  and  RMMS 
corrective  actions  In  order  for  the  system  to  become  a  reliable  member  of  the  NAS. 
These  problesis  potentially  affect  both  the  operational  use  of  the  TDUR  and  the 
maintenance  philosophy  of  the  unmanned  site. 

7.2  OT&E  OPERATIONAL  FUTDRE  TESTING. 

ACU-200D  will  perform  operational  tests  on  the  Build  5A  at  Memphis,  TN,  and 
Build  5B  at  Denver  (new  airport) .  Continued  tiser  Involvement  Is  necessary  to 
ensure  present  and  future  product  satisfaction.  Future  0T6£  will  need  to  address 
reliability,  availability,  and  maintainability  Issues. 
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1^2-1  RalUbllltv. 

Build  S  hardware  and  software  failures  will  be  documented  and  reported  during 
all  phases  of  OT&E.  Failures  will  be  investigated  to  determine  if  they  were 
inherent  to  the  software  and  hardware  or  were  nonrelevant  (induced  by  operator  or 
environment;  e.g.,  tornado  damage).  During  previous  operational  testing,  the  TDWR 
did  not  meet  specified  reliability  requireawnts  due  to  numerous  failures;  e.g., 
pedestal  and  coaq>uter  boards.  Test  personnel  will  document  all  hardware  and 
software  incidents/failures.  MTBF  will  be  documented  in  the  Build  5  test  reports. 
Test  personnel,  upon  verification  that  relevant  failures  have  occurred,  will 
document  MTBF  in  the  Final  OT&E  Operational  Test  Report.  Failures  will  be  reported 
to  participating  OT&E  test  organizations  and  the  Program  Office. 

2.2.2  Maintainability . 

Specific  problems  will  not  be  induced,  but  should  failures  occur,  the  time  to 
repair  will  be  documented  and  compared  to  established  maintainability  criteria. 

ZJLi — Fault  Detection  and  Fault  Isolation. 

Should  failures  occur  during  testing  of  Build  5.  the  effectiveness  of  fault 
detection  and  isolation  will  be  documented  and  analyzed  in  the  appropriate  0T6£ 
test  report.  RMS  OT&E  Integration  will  ensure  that  the  Build  5  software  has  not 
been  limited  in  its  ability  to  detect  communications  or  failures  related  to  the 
LLUAS  and  TDUR. 


7.2.4  Mean  Time  to  Repair  (MTTR) . 


Mean  Time  to  Repair  (MTTR)  will  be  computed  if  sufficient  data  is  collected  during 
failxtres  occxurring  during  the  Build  5  OT&E  test. 


OT&E  OPERATIOMAL  AND  TEST  OBJECTIVES. 


This  testing  is  to  ensure  the  operational  effectiveness  and  suitability  of  the 
equipsmnt  from  a  user  perspective.  Aspects  of  this  testing  are  further  defined  as 
follows: 


a.  Reliability, 

b.  Availability, 

c.  Degraded  operations  and  operational  utilization  scenarios, 

d.  Stress  and  NAS  loading  testing  of  all  interoperable  subsystems, 

e .  Human  factors , 

f.  Site  adaptation, 

g.  Transition  switchover. 


OT&E  OPERATIONAL  TEST  SCOPE 


[S...SCEHARlgS. 


NAS  operational  requirements  are  primarily  derived  from  NAS  System  Specifications, 
user  groups,  FAA  Orders,  Contract  Working  Papers,  Program  Directives,  Memoranda  of 
Agreement,  Operational  Concept  Documents,  and  subsystem  specifications.  ACW-200D 
will  determine-  the  methodology  for  evaluating  system  reliability,  huown  factors, 
and  transition  switchover  (such  as  when  the  TDWR  fails).  ACW*200D  will  develop 
scenarios  which  will  assess  degraded  operations  (such  as  loss  of  primary  power  and 
system  overload) .  Scenarios  will  be  developed  which  will  assess  maximum  loading  of 
processing  resources. 
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last  paraonnal  will  dagrade  the  systam  to  anaure  a  string  of  9s  are  displayed  for 
all  UJIAS  cantarfiald  wind  information  and  that  threshold  winds  are  blanked.  A 
single  ULVAS  sensor  will  be  disconnected  to  ensure  a  string  of  9s  will  be  displayed 
rather  than  the  wind  information  for  that  sensor. 

2. 5_ CRITICAL  OT&E  OPERATIONAL  TEST  ITEMS. 

a.  A  test  risk  exists  regarding  to  the  LLUAS  prime  development  contractor's 
ability  to  complete  the  LLWAS  III  to  TDUR  interface  software  within  the  test 
schedule  provided  at  appendix  A. 

b.  Reliable  operation  and  timely  receipt  of  weather  products  using  the  Build 
5  software  represent  critical  operational  test  items.  System  load  assessment  will 
require  innovative  test  techniques.  Test  methodology  will  need  to  be  developed 
which  will  evaluate  system  effectiveness  as  operations  degrade. 

c.  A  lack  of  appropriate  weather  (microbursts/Uind  Shears)  during  the 
schedule  teat  periods  will  impact  either  the  quality  or  completion  of  testing.  The 
OTfi£  Operational  Plan  will  include  contingency  planning  to  address  a  lack  of 
appropriate  weather  during  testing.  Weather  testing  shall  take  precedence  over  all 
other  testing. 


8.  -QT&E  SHAKEPQHH. 


Shakedown  typically  determines  the  overall  readiness  of  the  system  throu^  the 
analysis  of  human  factors,  procedures,  documentation,  logistics  support,  and 
technical  training.  Training  on  the  use  of  INCS  and  the  Maintenance  Management 
System  (MHS)  also  will  need  to  be  fully  assessed. 

AOS-S30  will  conduct  OT&E  Shakedown  for  the  TDWR  RMS/MPS  IHCS. 

AOS -200  will  construct  a  series  of  tests  that  meet  the  objectives  of  OT&E 
Shakedown. 

8.1^ OT&E  SHAKEDOWN  TO  DATE. 

Initial  Shakedown  was  accomplished  on  the  primary  TDWR  systems  by  AOS -200, 

October  13  to  Novesd>er  20,  1992,  at  Nesbit,  MI.  The  following  are  conclusions 
reached  by  the  test  personnel: 

a.  Equipment/system  status  monitoring  and  alarm  reporting  failed  when  the 
MFS/TDWR  (RMS  subsystem)  interface  failed  its  tests.  The  hximan  interface  would  be 
imusable  without  extensive  training  of  NCC  personnel.  Reported  performance, 
parameter,  and  alarm  Information  at  the  MDT  was  inaccurate  or  unusable. 

b.  Personnel  safety  failed  due  to  unsafe  maintenance  procedures,  the  lack  of 
emergency  exit  lighting,  and  a  poorly  fttnctioning  emergency  pushbutton.  The 
emergency  pushbutton  had  to  be  manually  depressed  for  4  or  5  seconds  to  achieve 
system  shutdown. 
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c.  Equl|HMnt/systeiB  performance  characteristics  failed  because  the 
parameters  required  for  accurate  weather  event  detection  were  not  optimized. 

d.  Facility  Reliablllty/Avallablllty  failed  because  an  engine/generator  was 
not  Installed,  nie  power  fall  recovery  tests  did  not  pass.  The  lightning 
protection  package  was  not  installed. 

e.  Maintainability  was  unsatisfactory  due  to  incorrect  alignment 
procedures  and  unusable  software  loading  procedures.  Logistics  support  was 
unsatisfactory  due  to  tmavailabillty  of  site  spares,  test  equipment,  and  special 
tools. 


f .  Workload  conditions  were  rated  unsatisfactory  because  maintenance 
procedures  are  more  time  consuming  than  projected.  In  addition,  the  maintenance 
workload  and  type  of  maintenance  requires  more  trained  technicians  than  initially 
expected. 

g.  Antenna  pedestal  vibration  testing  was  accomplished.  This  test  indicated 
a  high  probability  that  the  azimuth  bearing  had  failed.  Personnel  performing  the 
vibration  testing  noted  there  were  insufficient  inputs  for  grease  for  the  antenna 
elevation  bearings.  Improper  lubrication  will  cause  accelerated  wear. 

Followup  regression  testing  during  May  1993,  identified  siajor  issues  which  could 
impact  a  positive  recommendation  by  Shakedown  organizations  regarding  TDWR 
deploysMnt .  Issues  were : 

a.  System  Monitoring.  The  TDWR  experiences  repetitive  alarms  (instability 
residue,  system  noise.  Sensitivity  Time  Control  (STC)  calibration,  azimuth  servo 
reference,  etc.}.  Either  the  monitoring  software  or  the  conditions  for  monitoring 
a  data  point  are  catising  frequent  alarms.  These  repetitive  alarms  cause 
unxiecessary  SMintenance  and  loss  of  confidence  in  the  system.  The  MDT  reports  a 
constant  flow  of  alarms ,  alerts ,  and  Retum>To-Normal  (RTN) . 

b.  System  Diagnostics.  System  diagnostics  do  not  always  accurately  report 
the  failed  Lowest  Replaceable  Units  (LRUs).  Inability  of  system  diagnostics  to 
accurately  report  failed  units  will  extend  any  restoration  or  corrective 
uintenance  time. 

c.  Instruction  Looks.  Numerous  alignment  procedures  do  not  work  or  are 
incomplete . 

d.  System  reliability  remained  poor. 

8.2  Cyr&E  SHAKEDOWN  FUTURE. 

Future  testing  will  be  conducted  at  Denver  and  Memphis.  Tests  will  demonstrate 
whether  logistics,  training,  documentation,  and  other  operational  requirements 
have  been  awt.  AOS-530  will  conduct  IMCS  testing  at  the  FAA  Technical  Center, 
Atlantic  City  International  Airport,  New  Jersey,  prior  to  field  release. 
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Shakttdown  is  aecosplished  by  the  user  organizations  to  independently  evaluate  the 
following  operational  objectives: 

a.  NAS  system  integration  (validate  system  interfaces) , 

b.  Supportability  and  maintainability, 

c.  Subsystem/system  suitability  and  identification  of  operational 
deficiencies, 

d.  Site  adaption  parameters  optimized  and  archive  functional  verification, 

e.  Operational  procedures  are  available. 

These  Shakedown  objectives  will  determine  the  degree  to  which  Build  5  can  be 
reliably  placed  into  the  NAS. 


.4  QT&E  SHAKEDOWN  SCOPE.  EVENTS.  SCENARIOS. 

Shakedown  will  verify  requirements  denoted  in  the  site  colvimn  of  the  VRTM 
presented  in  appendix  B;  and,  those  effectiveness,  suitability,  maintainability, 
supportability,  and  integration  requirements  addressed  in  this  plan.  An 
experienced  technician  will  perform  test  scenarios  and  communicate  with  technical 
personnel  in  the  ATCT  and  at  interfacing  locations. 

ft, 4.1  Maintainability. 

a.  Technical  Instructions.  This  test  will  evaluate  software  documentation 
required  for  fielding.  Documentation  will  be  evaluated  for  cosipleteness  and 
clarity. 

b.  Operational  Accuracy.  This  test  evaluates  the  system's  capability  to 
accurately  present  readings  and  system  status  to  the  maintenance  technician. 

c.  Htiman  Factors.  This  test  assesses  the  human/machine  interface  to  ensure 
the  display  is  useable. 

8.4.2  Supoortabilitv. 

Supportability  for  Build  5  will  address  documentation,  and  adequacy  of  trained 
personnel,  configuration  management,  and  training. 

a.  Software  Documentation.  This  activity  will  determine  if  documentation 
(and  any  revisions)  are  readily  available  and  current. 

b.  Adequacy  of  Trained  Personnel.  This  activity  will  establish  AOS - 200 's 
capability  to  support  field  activities  from  a  total  system  perspective 
(software/hardware  otalntenance ,  configuration  management,  miscellaneoxis  technical 
support) . 


%.  Operational  Reliability.  Shakedown  personnel  will  have  access  to  the 
TDHR  Reliability  Analysis  Database  for  their  assessment  regarding  potential  system 
effectiveness  in  providing  reliable  service. 

b.  Backup  Power  Effectiveness.  This  activity  confirms  system  effectiveness 
in  operating  on  backup  power  or  on  airport  power. 

This  assessment  will  determine  suitability  of  display  information  and  system 
response . 


_ System  Integration. 

a.  Resolution  of  Test  Deficiencies.  Determines  if  OT&E  Integration  and  OT&E 
Shakedown  discrepancies  have  been  satisfactorily  resolved. 


b.  OT&E  Operational  Considerations.  Determines  if  enhanced  TDWR  operation 
will  have  any  negative  Impact  on  the  existing  air  traffic  control. 


OT&E  SHAKEDOWN  CRITICAL  ITEMS. 


Build  5  testing  cannot  be  isolated  from  the  overall  TDUR  system.  The  TDUR  system 
and  Build  5  together  oust  meet  system  required  operational  requirements  prior  to 
fielding.  Therefore,  OT&E  Shakedown  must  evaluate  the  TDWR  and  Build  5  as  a  single 
entity  and  previously  identified  failures  must  be  treated  as  critical  test  items. 

5.1  Equipment /System  Status  Monitoring  and  Alarm  Reportine. 

Previous  failure  of  the  MPS/TDWR  (RMS  subsystem)  interface  tests  will  require 
testing  to  ensure  performance/parameter  and  alarm  information  is  accurate. 


8.5i2 _ Personnel  Safety. 

Testing  will  need  to  ensure  that  all  \insafe  maintenance  procedures  have  been 
corrected,  emergency  exit  lighting  added  as  necessary,  and  emergency  pushbutton 
operation  timely  achieves  system  shutdown. 

_ Eqwipiwnt/Syg  tsm  • 

Testing  will  need  to  ensure  weather  event  detection  has  been  optimized. 
Installation  of  an  Engine/Generator  and  lightning  protection  package  will 
need  to  be  verified.  Power  fail  recovery  tests  will  need  to  be  reaccomplished. 

8.5.4  Maintainability. 


Maintenance,  alignment,  and  software  loading  procedures  will  need  to  be  verified  to 
ensure  their  useability.  Adequacy  of  site  spares,  test  equipment,  and  special 
tools  will  need  to  be  reassessed. 


Revised  ■elntenence  procedures  will  need  to  be  evaluated  to  determine  if  the 
contractor  has  improved  maintenance  procedure  efficiency.  The  RMS  final 
configuration  will  need  to  be  evaluated  to  determine  if  it  will  reduce  the 
previously  Identified  unacceptable  technician  workload. 

8.5.6  Other  Considerations . 

Follow* on  testing  will  need  to  ensure  adequate  inputs  for  grease  for  the  antenna 
elevation  bearings  have  been  added  to  minimize  wear. 


9.  SPECIAL  RESOURCE  SUMMARY. 

9.1  TEST  FERSOHWEL. 

a.  NSSL  will  provide  experienced  meteorologists  for  OT&E  Operational  test 
planning,  procedure  development,  test  conduct,  and  reporting. 

b.  ACW-200D  will  provide  an  ATC  analyst  to  accomplish  ATC  operational 
testing. 

c.  ACW*200D  will  require  test  engineers  to  draft  plans,  procedures,  conduct 
testing,  and  draft  reports. 

d.  A0S*200  will  require  test  personnel  to  accomplish  program  monitoring  and 
accommodate  test  activities. 

e.  Regional  manpower  will  be  required  for  system  and  maintenance  support. 

9.2  SFECIAL  SVPfQRT  REQVIREMEHTS. 

9.2.1  MPS  Simulator. 

Synchronous  EnHPS  Comonmications  Simulator  and  IMl  Protocol  Analyzer  (version  8.0) 
will  be  required  for  testing  link  level  communications . 

9.2.2  Software. 

TDWR  RMS/MPS  testing  will  require  updated  IMCS,  TDWR  RMS  Terminal  Software,  and 
Procomm  software  for  the  MDT.  Database  software  such  as  DBIV  should  be  procured 
and  used  for  analysis  of  failure  data. 
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10.  AGROmS  m  ABBREYATIQ^S. 


AAS 

ADCCP 

AF 

APME 

APML 

AH!T 

ARENA 

ASU 

AT 

ATC 

ATCT 

ATR 

ATQ 

Bd 

bps 

CDRL 

CFW 

CMTP 

CSCI 

DFU 

DRR 

DT&E 

EMC 

EMI 

EXCCM 

FAA 

FAR 

FCC 

GFI 

GSD 

ICD 

ICDDT 

IC&A 

IMCS 

lOT&E 

LLUAS 

LUNAS  II 

LUNAS  III 

LUNAS  N£ 

LRU 

MDT 

MMS 

MPS 

MSIA 

MTBCF 

MTBF 

MTTR 

M&OS 

NAS 

NCP 

NE 


Advanced  Automation  System 

Advanced  Data  Communications  Control  Procedures 
Airway  Facilities 

Associate  Program  Manager  for  Engineering 

Associate  Program  Manager  for  Logistics 

Associate  Program  Manager  for  Test 

Area  Noted  for  Attention 

Office  of  Acquisition  Support 

Air  Traffic 

Air  Traffic  Control 

Airport  Traffic  Control  Tower 

Associate  Administrator  for  Regulation  and  Certification 
Office  of  Independent  Operational  Test  and  Evaluation  Oversight 
baud 

bits  per  second 

Contract  Data  Requirements  Lists 
Center  Field  Nlnd 
Contractor's  Master  Test  Flan 
Computer  Software  Configuration  Item 
Display  Functional  Unit 
Deployment  Readiness  Review 
Development  Test  and  Evaluation 
Electromagnetic  Compatibility 
Electromagnetic  Interference 
Executive  Committee 
Federal  Aviation  Administration 
False  Alarm  Ratio 
Federal  Communications  Commission 
Government  Furnished  Item 
Geographic  Situation  Display 
Interface  Control  Document 

Interface  Control  Document  Database  Development  Tool 
Initial  Checkout  and  Acceptance 
Interim  Monitor  Control  Software 
Independent  Operational  Testing  and  Evaluation 
Low  Level  Wind  Shear  Alert  System 

Low  Level  Nind  Shear  Alert  System  (Six  Sensor  System) 

Low  Level  Wind  Sh^ar  Alert  System  (Network  Expansion  System) 

Low  Level  Nlnd  Shear  Alert  System  (Network  Expansion  System) 

Lowest  Replacement  Unit 

Maintenance  Data  Terminal 

Maintenance  Management  System 

Maintenance  Processor  Subsystem 

Microburst  Shear  Integration  Algorithm 

MeSn  Time  Between  Critical  Failures 

Mean  Time  Between  Failure 

Mean  Time  To  Repair 

Maintenance  and  Operations  Support 

National  Airspace  System 

NAS  Change  Proposal 

Network  Expansion 
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nml 

NSSL 

NTIA 

OT&E 

PAT&E 

PM 

POD 

PRF 

RDA 

RFI 

RDT 

RMMS 

RMS 

RHSC 

RPG 

RTN 

SON 

S/SDD 

SOU 

STC 

TCCC 

TDUR 

TEMP 

T&E 

TPRC 

TSSR 

VRTM 


nautical  miles 

National  Severe  Storms  Lab 

National  Telecommunications  Information  Agency 

Operational  Test  and  Evaluation 

Production  Acceptance  Test  and  Evaluation 

Program  Manager 

Probability  of  Detection 

Pulse  Repetition  Frequency 

Radar  Data  Acquisition 

Radio  Frequency  Interference 

Ribbon  Display  Terminal 

Remote  Maintenance  Monitoring  System 

Remote  Maintenance  Subsystem 

Remote  Maintenance  Subsystem  Concentrator 

Radar  Product  Generation 

Return- to - Normal 

Specification  Change  Notice 

System/Segment  Design  Document 

Statement  of  Work 

Sensitivity  Time  Control 

Tower  Control  Computer  Complex 

Terminal  Doppler  Weather  Radar 

Test  and  Evaluation  Master  Plan 

Test  and  Evaluation 

Test  Policy  Review  Committee 

Test  Schedule  Status  Review 

Verification  Requirements  Traceability  Matrix 


APPENDIX  A 

BUILD  5  TEMP  SCHEDULE 


APPENDIX  B 
VRTMS 
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T«r«lMl  Dtfvler  Weather  Radar 
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TERMINAL  DOTPLER  WEATHER  RADAR 
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'Aialysii.  Nlrapectioo,  X=Nol  Applicable.  Q<*Nol  Available  in  the  NAS 


TKRMINAL  DOrPlXR  WEATHER  RADAR 

NAS^INO  VOLUME  III  TEST  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 
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Vcrilicatioii  Methods:  T=Test,  D=Deinonstiaiioii,  AsAnalysis,  I=Inspection,  X=Not  Applicable,  QsNot  Available  in  the  NAS 


terminal  DOPPLER  WEATHER  RADAR 

NAS^im  VOLUME  HI  TEST  VERHlCAnON  REQUIREMENT  TRACEABHJTY  MA 
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'Analysis.  Nlnspcdion,  X*Nol  Applicable.  Q=Nol  Available  in  (he  NAS 


TERMINAL  DOPPLER  WEATHER  RADAR 
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terminal  DOmjCR  WEATHER  RADAR 
IIM  VOLUME  HI  TEET  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 
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T=Teil.  DsDefflontiitkin.  A^Anlyiis,  Mnpection,  X^Ncl  Afipiicabie,  Q^Noi  Available  in  the  NAS 


TERMINAL  DO^I  JJt  WEATHER  RADAR 

NAS^INI  VOIAIME  V  RMSMIIT  VERIFICATION  REQUIREMENTS  HUCEAMUTY  MATRIX 
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TsTest,  D^DemoiMiitiaii.  A»Aiiilyiis,  Isliopectiaii,  Applicable.  Q*Nol  Available  in  the  NAS 


B-19 


TERMINAL  DOPTLER  WEATHER  RADAR 
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B-20 


/e*l.  D-Demonimtkm,  AsAmlyiis,  l■Inpectiall.  ApplicaUe.  Q=Nol  Available  in  the  NAS 


TERMINAL  MIPffiER  fVEATDER  RADAR 

NAS^lIM  VCHAiMK  V  RMS/MDT  VUUFICATMm  REQIilRIMENTS  TRACEAMUTY  MATRIX 


1 

O  u)  ^ 

a 

X 

O  I-  ai  S 

»< 

Q 

O  •-  w  g 

X 

e 111 

X 

Q 

1  1 

1 

o 

> 

t 

vl  i 

!!i  j 

ilj  * 

It" 

'i ' 

[ii!i 

1  >P }  j  ^ 

i  li'i  I  i 

m\h 

; »  i  i! ' 

1,  liiilii 

>  & 

^'1 

il- 

ri  : 

Z  W 

«■ 

n* 

4 

4 

< 

^  1 

I 

B-21 


TsTejl,  DsDemonlntian.  A»Analy*«.  t^MptcUon,  X«N«  AppUcRile.  Q=No»  Aviilible  in  the  NAS 


TsTest,  C^Demaastotion,  A«Aiialysis,  l«IiHpectiaii.  X»N«  Applicable.  Q=Noi  Available  in  the  NAS 


TIRMINAL  DOPPUR  WEATHER  RADAR 

NAS^MM  VOLUME  V  RMSMDT  VERlFtCATiON  REQUIREMENTS  TRACEABILITY  MATRIX 


'Analysis.  Islnspection,  X=rtot  Applicable.  Q=Nol  Available  in  Uk  NAS 


TERMINAL  DOEPLER  WEATHER  RADAR 

NAS^IPN  VOLUME  V  RMSMDT  VERIFICATION  REQUIREMENTS  TRACEABIITTY  MATRIX 


B-24 


T=Tea.  DsDemonstfadon.  A=AnaIysi8,  I^lwpectioa.  X=N«  Afiplicabie.  QaNol  Available  in  the  NAS 


TERMINAL  DOPPLER  WEATHER  RADAR 

NAS5S-IMt  VOLUME  V  RMSAIDT  VERIFICATlim  REQUIREMENTS  TRACEABIIJTY  MATRIX 
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VcrificaHon  Methods:  T=Tesi.  D=Demonstiation,  A=Analysis,  I=lnspectioii.  X=Noi  Applicable,  Q=Not  Available  in  the  NAS 


TERMINAL  DOPELER  WEATHER  RADAR 

NASSS-IN*  VOLUME  V  RMSAIDT  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 
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VcrifkatiM  Methods;  T=Tesl,  D^Demonstiation,  A^Analysis,  l^lnspection.  X=Not  Applicable.  Q=Not  Available  in  the  NAS 


TERMINAL  DOPPIJIR  WEATHER  RADAR 

NAS-SS-lIN  VOLUME  V  RMSMDT  VERinCATION  REQUIREMENTS  TRACEABILITY  MATRIX 
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VerillcaliM  Mctkodi:  T=Test,  D^DentotBiiatioii.  AsAnalysis.  I=Inspectioii,  X^Nol  Applicable.  Q=Not  Available  in  (he  NAS 


TERMINAL  DOPPLER  WBATIIER  RADAR 

NAS^lIM  VOLUME  V  RMSAIDT  VERinCATlON  REQUIREMENTS  TRACEABILITY  MATRIX 


=AnalyM*.  I=In*pection.  X=N«  ApfiticaUe.  Q=Nol  Available  in  the  NAS 
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imion.  A=Analysii.  l»lwpec(ioii,  X«Nol  A|)|)iicable.  Q=Nrt  Available  in  the  NAS 


TERMINAL  DOPPLER  WEATHER  RADAR 

IIM  VOLUME  V  RMSMDT  VERIHCATION  REQUIREMENI8  TRACEABOm  MATRIX 
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r=Tea.  D^Demontmion.  AsAnalysis.  I^Iniiectian.  X«»N«  Afiplicabie.  Q=Noi  Available  in  the  NAS 


TBRMMAL  DOPnLBR  WBATIItR  RADAR 

NAMS-tIM  VOLUMB  V  RMSMDT  VEkOKATtON  RBQUIRBMENTS  TRACEAMUIY  MATRIX 
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TsTcsl,  D=Demomtnlioii,  AsAnalysis,  Nlmpectkm.  X^Noi  Applicable,  Q^Noi  Available  in  the  NAS 


Tcrmiul  Doppler  Weatker  Radar 

Bum  5  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 
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Display  Function:  TDWR  will  diuilay 
integrated  TDWR  and  U.WAS  infomuNion. 

Archiving:  TDWR  will  aulonutically  archive 
(he  iaiest  fifteen  (iS)  days  of  products. 

‘iDWR  will  provide  IJ.WAS  wind  products 
provided  by  (he  IJWAS. 

Relation  between  Products,  Algorithms,  Maps, 
and  Alarnis:  Government  will  provide 
algorithms  to  derive  hazardous  weather 
inTonnation  Aon  (he  base  radar  and  LLWAS 
data. 

Hie  TDWR  wUI  provide  LLWAS  wind 
inTonnation,  center  fields  and  runway  tlueshoid 
winds,  along  with  TDWR  weather  products  on 
(he  situational  display  and  RDT.  TDWR  will 
interiaoe  with  LLWAS  HI  when  both  systems 
exist  at  a  site. 
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VKRIMCATION  MKTIIOD:  T=TEST.  D=nEM()NSntAnON.  A=ANAI.YSIS.  NINSPFXmON.  X=NOT  APPI  ICABLE.  Q^NOT  AVAIIABI£  IN  TOE  NAS 


TcrMhuil  D«ppkr  Weather  Radar 

BaHd  5  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 
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VERIFICATION  METHOD:  T='reST.  D=DEM0NSTHAT10N.  A=ANALYSIS.  NINSPECITON.  X=NOT  APPLICABLE.  Q=NOT  AVAHABLE  IN  TOE  NAS 


TcnnkMl  Doppler  Weather  Radar 

BviM  5  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 
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Termfiial  Doppler  Weather  Radar 

Build  5  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 
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VERinCATION  METHOD:  T=-reST.  D=DEMONSTTlAnON.  A=ANAIYSIS.  NINSPECTION.  X=NOT  APPLICABI,F,  Q=Nar  AVAHABLE  IN  THE  NAS 


TcraiMl  Doppler  Wcatkcr  RMitr 

BuiM  5  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 
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VERIFICATION  METHOD;  T*TEST.  I>=DEMONSTRATION.  A=ANALySIS.  I=INSPECnON.  X=NOT  APPLICABLE.  0=NOT  AVAILABLE  IN  TOE  NAS 


Terniaal  Doppler  Wcatkcr  Radar 

BirfM  5  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 


VERIFICATION  METHOD:  T=TEST.  I>=DEMONSTRATION.  A*ANALYSIS.  NINSPECHON.  X=NOr  APPLICABLE.  Q=NOT  AVAILABLE  IN  THE  NAS 


Tcnalul  IHippter  Weatkcr  Radar 

Build  5  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 
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Archived  Data  Eiasing.  The  Situation  Display 
shall  not  erase  or  overwrite  the  archived  daa 
except:  1)  in  response  to  explicit  physical  and 
software  actions,  such  as  password  eiSiy  and 
mechanical  switching;  or  2)  to  overwrite 
archive  data  that  is  over  fifteen  days  old  in 
order  to  archive  new  data. 

Size.  A  standaid  size  and  a  small  envelope 
size  Ribbon  Display  will  be  required.  The 
Ribbon  Display  sh^l  have  the  least  area 
required  to  di^ay  10  lines  of  2S  charactets. 

Readability.  The  Ribbon  Display  shall  be 
readable  in  full  sunlight.  The  Ribbon  Display 
shall  be  readable:  1 )  from  a  distance  of  ten 
feet  and  at  angles  of  60  degrees  from  oettter 
line  for  the  Standard  Ribbon  Display;  and  2) 
from  a  distance  of  6  feet  and  at  angles  of  —  60 
degrees  from  center  line  for  small  Envelope 
Ribbon  Displiiy.  No  hood  shall  be  used. 
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VERIFICATION  METHOD:  T=TEST.  D=DEMONSniATION.  A=ANALYSIS.  ^INSPECTION.  X=NOr  APPLK^ABI  E,  Q=NOT  AVAILABLE  IN  HIE  NAS 


Teniilnai  Doppler  Weather  Radar 

BuiM  5  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 


Due  10  the  extensive  number  of 
failures  observed  on  the  TDWR 
during  operational  testing,  the 

DT&E  Demonstration  cannot  be 
used  as  an  indicator  that  the  system 
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Mean  Time  Between  Failure.  The  TDWR  shall 
have  MTIiF  as  follows; 

TDWR  System:  550 

Base  Data  Recorder  5000 

Portable  Base  Data  ;>'vd  Product  Display:  5000 
Situation  Disdav:  jO 

Ribbon  Display;  9000  hours. 

Display  Blanking.  The  Ribbon  Di^ay  screen 
shall  be  blanked  and  an  equipment  status 
message  displayed  when  any  of  the  following 
conditions  occur.  1)  Ribbon  Display 
communication  is  inletnipied  longer  than  an 
adaptable  time  period  (with  a  default  value 
equal  to  approximately  1  minute).  2)  the 

TDWR  arid  LLWAS  is  non-operational  (hie  to  a 
failure,  3)  the  GSD  Display  fails.  The  Ribbon 
Display  shall  resume  operation  when  the 
blanking  conditionfs)  no  loi%  exists. 

SPBCIFICATION 

FAA-E-2806/1 

3.4. 1.3.1 

20.1.2.1.6 

IS 

SI025 

SI026 

B-39 


VERIFICATION  METHOD:  T=TEST,  D-DEMONSTRATION,  A=ANALYSIS.  l=INSPECnON,  X=NOT  APPLICABIF,  Q=NOr  AVAILABLE  IN  TOE  NAS 


